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We consider effects of the Non-Standard Interactions (NSI) on oscillations of the 
high energy atmospheric neutrinos. The v„— oscillograms are constructed and their 
dependence on the NSI strength parameters e a R studied. We computed the zenith 
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(~ — , angle distributions of the Vn— events in the presence of NSI in different energy regions 



The distributions are confronted with the IceCube- 79 (high energy sample) and the 
DeepCore (low energy sample) data and constraints on the strength parameters 



\ e ^r\ ^ 6 x 10 3 and |e w — e TT \ < 3 x 10 2 (90% C.L.) have been obtained. Future 



measurements of the zenith angle distributions by DeepCore in several energy bins 



£S| will allow to improve the bounds by factor 2-3. We discuss the signatures of NSI 

> 

in the zenith angle and energy distributions of events which allow to discriminate 

them from the effects of sterile neutrinos. 

o 

en I- INTRODUCTION 



Searches for effects of Non-Standard Interactions (NSI) of neutrinos is one of the avenues 



to uncover new physics beyond the standard model (see [TJ |2] for review). The NSI can 
show up in neutrino production and absorption or scattering in a source and detector. They 
can affect neutrino propagation in medium modifying the standard oscillation pattern. The 
NSI effects in production (absorption) and in propagation may, or may not, be related and 
interplay of these effects is possible. 

At the phenomenological level the NSI of neutrinos are described by the strength param- 
eters, e a/ 3, which enter the effective potentials e a prVcc generated by the coherent v a — > z/g 
forward scattering. Here Vqc — V%GF n e, Gf is the Fermi coupling constant and r = nd/n e , 
where rid and n e are the number densities of d-quarks and electrons correspondingly. 



Effects of NSI in the atmospheric neutrinos have been considered in a number of pub- 
lications before (see [3] and references therein). Also, the effect of NSI on propagation of 
accelerators, solar and supernova neutrinos have been studied (see [2] and references therein). 
Furthermore, using various restrictions [I] derived from oscillation data, neutrino scattering 
off charged leptons and quarks, lepton flavor violating processes and electron-positron scat- 
tering the following model-independent bounds on the NSI strength parameters have been 
obtained in [5]: 

e MT <0.21, e w < 0.046, e TT < 9. (1) 

The Super-Kamiokande collaboration performed a dedicated experimental search of NSI 
in the atmospheric neutrinos crossing the Earth [6]. No effect has been found which leads 
to the upper bounds (at 90% C.L.) 

|e MT | < 1.1 x 10- 2 , |e'| = |c w - e TT \ < 4.9 x 10" 2 . (2) 

Recently, using both neutrino and antineutrino beams, the MINOS collaboration has ob- 
tained bound on the off-diagonal parameter —0.20 < e MT < 0.07 (90% C.L.) [TJ. 

In [S] , the possibility to constrain NSI in the proposed PINGU extension of the IceCube 
detector has been explored. It was shown that, due to the high efficiency in detection of low 
energy (1 — 20 GeV) atmospheric neutrinos, PINGU may have good sensitivity to e^ T . 

It is expected that NSI produce sub-leading effects in flavor oscillations of neutrinos. 
However, in certain situations their effects can dominate or be enhanced. It is well-known 
that the standard oscillations in matter disappear with increase of neutrino energy. Indeed, 
for the v e — oscillation modes, the mixing in matter decreases with energy as sin 2 29 m oc 
(2E l/ Vcc) 2 ', although the oscillation length converges to the refraction length which is 
comparable to the Earth's radius. In contrast, for the z/ M — and v T — modes at high energies 
the mixing angle is unsuppressed. However, in this case the oscillation length (which nearly 
coincides with the vacuum oscillation length) increases with energy and becomes much bigger 
than the size of the Earth. Consequently, the oscillation phase and therefore the oscillation 
effects become very small. 

In the presence of non-standard interactions the situation can be different, if the off- 
diagonal elements are nonzero. In this case oscillations do not disappear with increase 
of the neutrino energy, and their characteristics will be determined by the matter part of 
Hamiltonian. This means that appearance of oscillation effects at high energies will testify 



for NSI. At very high energies (which are inversely proportional to e) NSI dominate over 
standard oscillations and in this range their signal is simple and clear. On the other hand, 
in the range E v ~ (20 — 100) GeV, NSI can interfere with standard oscillations which leads 
to enhancement of the NSI effects. 

In this connection we propose to search for NSI at energies E v > 20 GeV with huge 
atmospheric neutrino detectors: the IceCube and DeepCore. We show that the already 
collected statistics in these experiments allows to substantially improve the current bounds 
in Eq. (§. 

The paper is organized as follows. In Sec. [IT] we compute and study properties of the 
oscillation probabilities in the presence of NSI. We construct the corresponding oscillograms 



and explore their dependence on the NSI strength parameters. In Sec. Ill we compute the 
zenith angle distributions of the z^— events in the low and high energy regions. We use the 
IceCube-79 and DeepCore data to obtain bounds on the NSI strength parameters. Future 



sensitivity of DeepCore to these parameters is evaluated. In Sec. [IV] we discuss how the NSI 
effects can be disentangled from the possible effects of sterile neutrinos. Conclusions are 
presented in SecjVj 

II. OSCILLATION PROBABILITIES IN THE PRESENCE OF NSI 

A. NSI strength parameters 

NSI's modify neutrino forward scattering, and consequently, the usual pattern of flavor 
oscillations. In the presence of NSI evolution of neutrinos in matter can be described by the 
Hamiltonian 

H 3u = ^U PMNS M 2 Ul MNS + dmg(Vcc, 0, 0) + J^ V f e* , (3) 

/ 

where £/pmns is the PMNS mixing matrix, M 2 = diag{0, Am| 1; Am^}, and Amfj = mf—m 2 
are the neutrino mass-squared differences. The last term of Eq. (pi) is the matter potential 
resulting from the NSI of neutrinos. The contribution from neutrino scattering on fermion 
of type /, v a + f — )■ v$ + f, is given by Vf€^, with Vf = \/2Gprif, where nf is the number 
density of fermion / and e* is the matrix of NSI strength parameters. For antineutrinos 
the sign of potentials would change, V — ¥ —V, and mixing matrix equals the conjugate 



one: U PMNS . 

Normalizing the density of fermions rif by the density of d— quarks, rid, we define the 
total strength for a given medium as 

e^Y^ef. (4) 

f 

Then the NSI term in Eq. (J3l) can be rewritten as V^e = rVcc^-, where r = rid/n e . For 
the Earth we have n n rj n p (departure from equality is less than 3%) and therefore r = 3. 
Finally, the Hamiltonian takes the form: 

H 3u = -Lt/ PMNS M 2 [4 MNS + Vbcdiag(l, 0, 0) + rV cc e , (5) 

ZEi v 

where the Hermitian matrix of NSI strength parameters e can be written as 



6 e/x ^MM e M r 



(6) 



\ fc er t iir t TT I 

The hermiticity of e implies that the diagonal elements of the matrix are real and we assume 
that the non-diagonal elements are also real: e a/ 3 = e* a o. Furthermore, for simplicity we will 
neglect the elements of the first raw and column, assuming that e 6j g <C e Mr for (/3 = e,fi,r). 

The oscillation probabilities Piy^ — > v^) and Piy^ — > u T ), which we are mainly interested 
in this paper, are sensitive to e MT , that quantifies strength of the flavor changing neutral 
current interaction v^ + f — V v r + f, and e' = e TT — e w , which gives the non-universality of 
Up and v T neutral current interactions. To find the oscillation probabilities in the presence 
of NSI, we solve numerically the 3z/ evolution equation with the Hamiltonian in Eq. (p)]). 
For the density profile of the Earth we use the PREM model [S]. We take the best-fit 
values of oscillation parameters from the global fit in [TO]: sin 2 #13 = 0.023, sin 2 9 12 = 0.30, 
sin 2 fl 23 = 0.4, Am 2 ! = 7.5 x 10" 5 eV 2 and Am 2 x = 2.4 x 10~ 3 eV 2 . 

In general, the parameters e a p depend on composition of medium and so change on the 
way of neutrinos. We will neglect this dependence. 

B. Features of oscillations in 2v approximation 

If e ee , e efJi , e eT <C 1, then at energies much above the 1-3 resonance [E v > 20 GeV) the 
state v Zm « u e [p\ m ~ &e) decouples from the evolution of the rest of the 3z/ system. In this 



case results from the 2v system provide good approximation and allow us to understand the 
main features of NSI effects. 

In the 2v case the effective Hamiltonian can be written as 

h 2u = ^u(e 23 ) r°) u\e 23 ) + v d ( e - y J , (7) 

where 1/(823) is the 2x2 rotation matrix with the angle 6*23. At very high energies, 
Aml 1 /2E U <C Vje, the second term dominates and dynamics of propagation is completely 
determined by matter effects. In this limit diagonalization of the Hamiltonian in Eq. ([7]) 
gives the mixing angle 

sm2£= Jfe^g , (8) 

and the level splitting 



AH m = V NS1 = V d J4el T + e' 2 . (9) 



The parameters sin 2£ and Vnsi determine the pattern of oscillations at very high energies, 
so that the transition probability equals 

P(v ll ->■ v T ) = sin 2 2£ sin 2 (j) matt . (10) 

Here the matter half-phase, 4> ma tt, equals 

VnsiL VdL 



matt- ^— -— y4e 2 T + e' 2 , (11) 

where Vd is the averaged potential along the neutrino trajectory. (We assume that e MT and 
e' are constants.) Numerically, 

P —A(— 

5.5 g cm" 3 ; \2R Q 



w* - 35 ( KK /__ 3 ^- J4e£ r + e' 2 , (12) 



where 

2 f^ 2 

p = — dxp(x) 



Ljo 



is the average density along the neutrino trajectory and i?© is the Earth's radius. 

With decrease of e a p the potential Vnsij an d consequently, the phase 4> m att decrease. 
When (fimatt <C 1, we obtain from Eqs. (J8]), (J9f and (11), the probability 



P(i/ M -> z/ T ) « (e^VdL) 2 , (13) 



which reproduces the result of [TT]. It does not depend on e', so that high energy data restrict 
e MT and are insensitive to e'. The same result is valid for both neutrino and antineutrino and 
for both signs of e^v- 



The result in Eq. (13) allows us to immediately estimate sensitivity of a given experiment 



to e^ T . From Eq. (13) we have 



-fiu 



V d L 



P(Ua -¥ V T ) . 



(14) 



For atmospheric neutrinos the maximal value VdL m 62 corresponds to the trajectory along 
Earth's diameter, so that e™ n = 0.016vP. For the ~ 10% accuracy of measurement of the 
probability, FrsO.1 (what we have now), we obtain e™™ = 5 x 10~ 3 . The accuracy ~ 1% 



(which can be considered as the ultimate one) leads to e 



fj,i/ 



2 x 10 3 . The sensitivity in 



this region is restricted since the NSI effects are quadratic in strength P ex e 2 . 



Using parameters £ and Vnsi, we can rewrite the Hamiltonian in Eq. (ffl) as 



H- 



2u 



Aw 4 

2E V 



i o \ . / 

u(6 23 ) u\e 23 ) + R u(0 

1/ I 1 



^(0 



Here 



Ro - 2 4^ = V2G F n dx f^7^ 



Am 2 31 



-[IT 



Am 2 31 ' 



(15) 



(16) 



is the relative strength of matter and vacuum contributions, or is the splitting due to matter 
effect in units of the vacuum splitting. Numerically 



Rn = 0.5 



5.5 g cm -3 / \GeV J 



P 



Kt + £ 



r> 



(17) 



Diagonalizing the Hamiltonian in Eq. (15) we find the difference of instantaneous eigen- 
values 

AHm = ^K R ' (18) 

where the resonance factor R equals 



R 2 = 1 + Rl + 2R cos 2{d 23 - = [Ro + cos 2{6 23 - £)] 2 + sin 2 2{6 23 - f) . (19) 



The mixing angle m is given by 

sin 2 26 r 



-^(sin2^ 3 + J Rosin20 2 



(20) 



or explicitly, 

2 R _ (sin2g 23 + fiosin20 2 

m ~ 1 + Rl + 2i? cos 2(^3 - ' l j 

The oscillation half-phase equals 

$ m = AF m | = (^J^) [1 + ^ + 2/? cos 2(0 2 3 - 0] V2 • (22) 

It can be rewritten as 



$m = (</Wc + <Pmatt) \l 1 " (1 ^ )2 [1 " COS 2(0 23 - 0] , (23) 



where 



vac = ~IeV 



(24) 



is the vacuum oscillation half-phase. 

In the case of constant density, oscillation probabilities have standard expression with 
oscillation depth and length given by sin 2 26 m and 27i/AH m : 



P(y^ -> i/„) = 1 - sin 2 26 m sin 2 (^^r\ 



(25) 



If e^ T changes the sign, e Mr — > — e MT , in the above formulae we need to change £ — > — £; 
for e' —7- — e', we replace cos 2(6*23 — £) — > — cos2(6 ) 23 + 0- Changing the signs of both 
parameters e MT and e' is equivalent to R —¥ — i?o- In the above formulae we assumed normal 
hierarchy of neutrino masses (Am^ > 0). Inversion of the hierarchy can be described by 

Am 2 ^ — > -Arrigj. 



According to Eq. (19) the resonance condition, which ensures minimal value of the reso- 
nance factor, reads as 

Ro = -cos 2(0 23 -0 • (26) 

(For C, = it reduces to the usual MSW resonance condition.) Then the resonance energy 
equals to 

En = -^ cos2(^3 -0 = - 9 „ A r^$—^ ™s2(9 23 - . (27) 

2Vnsi 2V dx /4ef lT + e' 2 

For e a /3 ~ 10~ 2 , which is at the level of current sensitivity, we obtain Er ~ 100 GeV. 

In resonance we have 

i? 2 = sin 2 2(^3 -0 = 1-^0, 



and the mixing in Eq. (21) becomes 

sin 2 29 m = cos 2 2£ . (28) 

For £ = this equation reproduces the usual result sin 2 20 m = 1. In contrast, if the matter 
mixing is maximal, £ = 7r/4, we obtain sin 2 20 m = 0; i.e., mixing disappears in resonance. 
The oscillation phase in resonance equals 

<Sf m = —^~ sin 2(0 2 3-O • (29) 

The resonance is in the neutrino channels for negative e's and in the antineutrino channels 
for positive e's. 

Maximal interplay between the vacuum parameters and NSI is at energies E ~ Er or 
Rq ~ — 1. The resonance energy increases with the decrease of e's. In the range E ~ Er 
the probability depends on e's linearly due to interference with usual oscillations, as can be 



seen from expression for mixing angle in Eq. (20). 



The ratio Rq quantifies the relative effect of NSI. For Rq — > (low energies) we have 
£ = 0, R — y 1, and the parameters of oscillations reduce to the vacuum values: 

A Tft 

sin 2 29 m = sin 2# 23 , AH rn -> — -^, $ m -> (j) vac . (30) 

In the limit of high energies, that is, Rq —¥ oo and R — >■ i?o, w e reproduce the matter 
dominating results in Eqs. ([8]) and (|9]): 

sin2e m ^sin2£, AH m ^V mi . (31) 

With the decrease of e's the energy where NSI effect becomes dominating increases, but 
the oscillation length increases as l m oc l/AH m ~ 1/e. At very small e, the length l m 
becomes much larger than the diameter of the Earth and the oscillation phase becomes 
small (pmatt < 1. In this case expanding the sine in the expression for the probability we 

obtain 

/Am 2 L\ 2 
P(^ -► v„) = 1 - (sin 2fl 23 + Rq sin 2£) 2 ■ f ~^~ J • (32) 

For £ = we would reproduce the "vacuum mimicking" result [HI [T2] for which the proba- 
bility coincides with the vacuum oscillation probability in spite of the fact that the matter 
effect dominates (Rq > 1). For £ ^ there is a deviation from the "vacuum mimicking". 



For Rq ^> 1 we obtain from Eq. (32) the expression in Eq. (13). 

Results for antineutrinos can be obtained by changing the sign of i?o : Rq —> —Ro, or 
equivalently by change of signs of all e's (or V^). 



C. Probabilities for two extreme cases 

Let us consider two extreme cases: 

1). Flavor off-diagonal NSI: e^ T ^ 0, and e' = e TT — e w = 0, which corresponds to the 
universal NSI. In this case we have: sin 2^ = 1. The mixing parameter equals 

sin226 - (sin2fl 2 3 + /?o) 2 1 

m 1 + R 2 + 2^0 sin 20 2 3 1 + cos 2 20 23 (i2o + sin 2 M~ 2 ' 

and it converges to maximal one for large R$. The resonance factor becomes 

R 2 = [Rq + sin 26 23 } 2 + cos 2 20 23 . (34) 

In resonance the phase is suppressed by the factor cos 2023: 

$ m = — ^- cos 2023, (35) 



see Eq. (29)) and it is zero for the maximal 2-3 mixing. Far from the resonance (Rq ^ —1) 



according to Eq. (23) the total oscillation phase equals approximately to the sum of matter 



and vacuum phases: 

Aml 2 L(l + R ) Am 2 32 L jr T 

*m ~ <Pvac + <Pmatt = 7^ = —77; h V d Le^ T , (36) 

so that modification of the phase is independent of neutrino energy. In the high energy 



regime, E v > 100 GeV, the standard contribution to the phase (the first term in Eq. (36)) 
becomes negligible, whereas the second one equals 

^ = 7 ° (s.Sg'cm-) (2^) £ - • (37) 

For neutrinos crossing the center of Earth, cos0 z = —1, this equation gives 4> ma tt — 62e^ T . 
The phase equals 7r/2, so that the muon survival probability reaches its minimum when 
e MT = 2.5 x 10~ 2 . For e^ T > 2.5 x 10 -2 the minimum of probability occurs at cos 9 Z > — 1. For 
example, for e^ T ~ 0.05, the probability Piy^ —¥ f„) ~ at cos0 2 ~ —0.8. In asymptotics 



for small e„ T we have according to Eq. (13) P — ,2 



matt' 



In Fig. [T] we show the v^— and v^— survival probabilities as functions of the neutrino 
energy with and without NSI. The plots correspond to opposite signs of e MT . According to 
this figure and our analytical consideration at low energies, E v < 100 GeV, NSI lead to 
shift of the oscillatory pattern to larger (1/) or smaller (p) energies for e AtT > 0. Indeed, for 
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FIG. 1: The oscillation probabilities P{yu 



(b) 



(a) and Piy^ — > v^) (b) as functions of neutrino 



energy for cos# 2 = —1. The dashed red curve is for NSI with parameters e^ T = 0.01 and e' = 0, 
and the solid blue curve is for the standard 3u oscillations. 



cos9 z = —1 the first minimum of the z/ p — > v^ vacuum oscillation probability 



IX 



/2) 



occurs at E v ~ 25 GeV. The second term of Eq. (36) leads to a shift of the minimum to 



higher or lower energies, depending on the sign of e MT . The mixing angle also modifies in 
the presence of NSI and the depth of minimum changes, although the change is small. 
In the case of e MT > and normal mass hierarchy the resonance is in the v channel 



(Vd < 0) and the resonance energy equals, according to Eq. p7[ ), 



Ami 

,! -sin 2^ 2 3 



(38) 



^ T V d {6 z ) 

For cos6 z = —1 we obtain Er ps 60 GeV. In resonance, Rq = — sin# 2 3> the mixing is zero, 
sin 2 20 m = 0, and oscillation effects are absent. This corresponds to P{p^ — > v^) = 1 



at E w 60 GeV in Fig. lb With the increase of energy both neutrino and antineutrino 



probabilities in Fig. 1 converge to the same asymptotic value 



matt' 



Figs, pq and p\ show oscillograms for the v^ survival probability in the high energy range 
[E v > 100 GeV) for e' = and different values of e^ T . The resonance energy is in the interval 
(80 — 200) GeV. The resonance is realized for negative values of e Mr (Fig. [3]). According to 



Eq. (28) in resonance (due to £ = 7r/4) the mixing becomes zero sin 2 2G m = 0. Furthermore, 
the matter and vacuum phases have opposite signs and cancel each other. As a result, the 
oscillations are strongly suppressed at E v ~ Er in agreement with our analytical considera- 
tion. Above resonance the matter dominated oscillations are realized and at E v ^> Er both 
signs of e^ r give the same results. 
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FIG. 2: The survival probability P(vu —> Vn) in the presence of NSI in the high energy range 
E u > 100 GeV for two different values of e MT . We take e' = 0. 
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FIG. 3: The same as in Fig. ^lbut for negative values of e^ T (or for antineutrinos) . 



Notice that at high energies usual vacuum oscillations are strongly suppressed, so that 
from these figures one infers immediately the difference of probabilities with and without 
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FIG. 4: The oscillograms for the survival probability P(vn —> Vn) in the presence of NSI (panels a 



and b) and the difference of probabilities with and without NSI (panels c, d) [see Eq. (39)] in the 
low energy range 10 GeV < E v < 100 GeV for two different values of e Mr . We take e' = 0. 



NSI. 



In Figs. [4] and [5] we show the v^ survival probability patterns in the low energy range 
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FIG. 5: The same as in Fig. Hfor negative values of e^ T (or for antineutrinos) . 



10 GeV < E v < 100 GeV for different values of e„, T . In this energy range, as expected 



from the analytical consideration in Eqs. (32) - (36), the NSI's lead to shift of the oscillatory 



pattern and in particular, minimum of v^ survival probability. The positive (negative) values 
of e^ T shift the pattern of P{y^ -» v^) to higher (lower) energies: E™ in ~ 24 GeV, 30 GeV 
and 38 GeV for e^ = 0, 4 x 10~ 3 and 10~ 2 correspondingly. The depth of the minimum 
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in P(Ufj, — > z/ M ) decreases for negative values of e MT . To illustrate the effect of NSI on the 
oscillation pattern, we also show in Figs. [4] and [5] the difference of probabilities 



)STD, 



V, 



A< 



^-P^^^f^O), (39) 



where P STD is the oscillation probability in the 3u standard framework without NSI. Maxi- 
mal difference is in the range 40 — 100 GeV, as well as at low energies 15 — 20 GeV. 

As follows from the Figs. El and [5] (bottom panels) interference of the NSI and usual 
oscillation effects has opposite signs in different kinematical (E u — cos 6 Z ) regions. Therefore 
to enhance the sensitivity to the NSI parameters one should avoid integration over regions 
of opposite signs. Comparing bottom panels in Figs. [4] and [5] we see also that the NSI effects 
have opposite signs for neutrinos and antineutrinos, and therefore summation of the v and 
v signals leads to partial (due to difference of the cross-sections and fluxes) cancellation 
of effects. Separation of the neutrino and antineutrino signals would allow to improve the 
sensitivity. 

2). Flavor conserving NSI: e Mr = 0, e' = e TT — e w ^ 0. Now NSI are flavor non-universal. 
In this case sin 2^ = 0, and for the mixing and mass splitting we obtain the usual MSW 
formulas with the potential given by Vnsi = V^e': 

9 ~ sin 2 2093 / s 

sin 2 29 m = -^ = , 40 

(R + cos 28 23 ) 2 + sin 2 2# 23 l ; 

and 

AHm = ^ [ (jR ° + C ° S 2M " + Sln2 2 ^ V2 • (41) 

Consequently, the oscillation probabilities will have the standard MSW dependences on the 



neutrino energy. The parameter R (from Eq. (17)) takes the value 



The resonance condition reads Ro = — cos 2#23, and the resonance energy is 

For e' = 5 x 10~ 2 we obtain Er ~ 10 GeV for the mantle crossing trajectories. Resonance 
enhancement of oscillation is very weak since the vacuum mixing is already large. Therefore 
the main effect of NSI is the suppression of oscillations at energies above the resonance 
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E v > Er. In non-resonance channel the suppression starts even at lower energies. With 
decrease of e' the region of small survival probability shifts to higher energies as E v oc 1/e'. 



The oscillation phase, Eq. (22), for neutrinos crossing the center of Earth can be approx- 
imated as 



<^\L +coB2B JE^\ t , + a2 JK\ 



2 



*™= 3 Hidv 1+cos M^r +0 - 25 U^J £ ' 2 - (44) 

The mixing angle equals 

sin 2 26 m = ^^ =— . (45) 

1+ cos 29 23 (<f-)e' + 0.25 (^)V 2 



Since £ = 0, at high energies (E u > E R ) the oscillation phase is small and the vacuum 
mimicking is realized with usual vacuum oscillation result. 

Let us estimate sensitivity to e' . Here, in contrast to very high energies, the effect is 
linear in e' due to interference with usual oscillations, although the linear terms appear in 
combination with the small factor cos 2023: 

5 = 2cos26 23 R = t — 2 • 

Thus, the linear terms appear only if there is a deviation of the 2-3 mixing from maximal. 
We assume that e' 2 terms are negligible which is realized for small enough e'. Then in the 
lowest approximation in 5, the change of oscillation probability due to NSI equals 

AP « 8 (- sin 2 <f) vac + 4> vac sin <j) vac cos <f) vac ) ■ (46) 

The sensitivity can be estimated as 

e ~ AP ^ (- sin 2 <\> vac + <p vac sin <p vac cos (j) vac ) . (47) 

The factor in brackets, which depends on the oscillation phase in vacuum, is typically smaller 
than 1. Therefore for AP = 0.1 and E v = 30 GeV we obtain e'~2x 10~ 2 . 

At high energies, E v > Er, the mixing is strongly suppressed, sin 2 20 m tn Rq 2 sin 2 26*23, 
and consequently, the oscillation effects vanish. 

Fig. M shows the oscillograms for Piy^ — > v^) and difference of oscillograms with and 
without NSI in the low energy range for e' = ±2.5 x 10~ 2 and e^ r = 0. Recall that change of 
the sign of e' is equivalent to transition from neutrinos to antineutrinos. According to Fig. [6] 
the range of the strong e' effect is at (20 — 40) GeV and it is stronger for positive values of 
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FIG. 6: The same as in Fig. ^lfor two different values of e' and e^ T = 0. 

D. Other contribution to the v^ events 

The v e — > Vp contribution to the v^ events is strongly suppressed at energies 
Ev ^ 20 GeV, since: (i) the original flux of electron neutrinos becomes substantially - 
a factor 5 - smaller than the muon neutrino flux; (ii) the transition probability P[y e — > v^) 
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is strongly suppressed by usual matter effect being smaller than 1%. 

Another contribution to the v^ events is from the v T flux formed by the v^ — \ v T oscilla- 
tions. The tau neutrinos produce tau leptons: v T + iV — \ r + X and in 17% cases r's decay 
as t — > v T + z/ M + fi. In average, muon takes 1/3 of the original energy of r, and therefore to 
reproduce the same configuration of the v^ event the original v T energy should be 3 times 
larger than the v^ energy. The corresponding flux is then 10 times smaller. Thus, the v T 
events give about 1 — 2% contribution. 



III. CONSTRAINING e^ T AND e' 

Let us find constrains on the NSI parameters {e} = {e MT , e'} from the atmospheric neu- 

" " '"*' we 



trino data collected by the IceCube-79 and DeepCore experiments. In subsection III C 
estimate the sensitivity of future DeepCore results. 

A. Zenith angle distributions of events 

In our analysis we use the atmospheric neutrino data collected by IceCube detector 
and named as the "low" and "high" energy samples [24"1 [25] . The high energy sample is 
recorded by the IceCube detector with 79 strings and corresponds to the energy interval 
100 GeV — 10 TeV. The "low" energy sample, (20 — 100) GeV, is composed of events 
detected by the DeepCore part of IceCube detector [15] . 

Using the probabilities P{v^ — ¥ f M )({e}) and P{y e — > f A1 )({e}) discussed in the previous 
section we compute the expected zenith angle distribution of events in the presence of NSI. 
The number of events in the z-th zenith angle bin equals 

^r P ({e})iow, high = TAn I dcos6 z f dE v (48) 

J Aicos0 z ./low, high 

[$„„(£„, cos ^Pfo -> ^)({e}) + $„.(£„, cos 0,)P(i/ e -> ^)({e})] A^(E V , cos 9 z ) 
where $i/ M (p M ) and § Ue (u e ) are the v^ (z/^) and u e (z/ e ) fluxes of atmospheric neutrinos [T3~t[T4"] 



and A&{E V , cos9 z ) is the effective area. In Eq. (48) Af2 = 2n is the azimuthal angular 



acceptance of the IceCube detector and T is the live-time of detector. We take 10 bins in 
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(a) (b) 

FIG. 7: The predicted zenith angle distribution of the high energy z^— events at IceCube with 
(red) and without (green) NSI. For NSI parameters we use (a) e^ T = 0.01, (b) e MT = —0.01, and 
e' = 0. The IceCube-79 data is shown by the black histogram. 



cos# 2 with width 0.1. The number of events in the 2-th bin is given by integration over the 
size of bin Aj cos 8 Z . 

In the high energy range effects of the standard neutrino oscillation are almost absent, 
whereas the low energy sample covers the first minimum of v^ survival probability. The 
experimental data are in a very good agreement with these expectations which allowed to 
claim observation of the atmospheric neutrino oscillation with ~ 5.6 a significance [24]. No 
deviation from the standard oscillation picture has been found and we analyze the "low" 
and "high" data samples to constrain the NSI parameters. 

Since the effective area A^g(E u , cos 9 Z ) is not published yet, we estimated it by re- 
weighting the known effective area of IceCube-40 [16] such that the simulated zenith dis- 
tribution of the IceCube-79 events is reproduced. As a cross-check, we also reproduced 
approximately the exclusion plot for the standard oscillation parameters (Amj^, sin 2 2^3) 
as in [21]. Although our limits, due to the cross-checks, are expected to be close to realistic 
ones, they should be considered as provisional and small changes are possible. 

In Fig. [7] we show the zenith angle distribution of events with and without NSI for 
the IceCube detector (high energy data). The distribution with NSI has been computed 
for e MT = ±0.01. We show also the data points from IceCube-79 [24J. The distribution 
without NSI is (up to an overall normalization) in very good agreement with data. The NSI 
lead to additional suppression of number of events in vertical (upward going) directions, 
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FIG. 8: Zenith angle distribution of the low energy Vn— events at DeepCore. Shown are the 
predicted number of events with NSI characterized by (a) e^ T = 0.01, (b) e^ T = —0.01, and e' = 
(red) and without NSI (green). The black histogram is the DeepCore data with statistical errors. 
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FIG. 9: The same as Fig. [8] for NSI characterized by (a) e' = 5 x 10~ 2 and (b) e' = — 5 x 10~ 2 and 



e^r = 0. 



cos# z < —0.7, and the corresponding distribution fits the data worse than the one without 
NSI. The distributions do not depend practically on the sign of e MT . 



In Figs. pi M and 10 we present zenith angle distributions for the DeepCore (low energy 



data). In Fig. Mwe show effect of e^ T which is relatively small. For e^ T > (resonance in 
the v channel) NSI further suppresses the number of events with the strongest effect in the 
bin [—0.9,-0.8]. This is because NSI shifts the oscillatory pattern to higher energies (see 
oscillograms in Sec.lll]). For e MT < (resonance in the v channel) the oscillatory pattern shifts 
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FIG. 10: The same as Fig. [8] for NSI characterized by (a) e^ T = 0.01, (b) e^ T = —0.01, and 



e' = 5 x 10~ 2 . 



to lower energies, effect is smaller and has an opposite sign (number of events increases). 
Fig. [9] shows effect of e'. In this figure NSI reduce the oscillation effect which leads to an 
increase in the number of events for both signs of e'. Indeed, according to our considerations 
in Sec. [TTJ the effect of NSI in this case is essentially reduced to suppression of oscillations 



at high energies relevant for DeepCore. Fig. 10 shows the combined effect of e» T and e'. The 



result can be understood from the two previous figures, and as can be seen, the effect of e' 
dominates. 

B. Constraints on e^ and e' from IceCube-79 atmospheric neutrino data 

To find bounds on the NSI parameters we define the \ 2 function for the low and high 
energy intervals as 



xL,hi g h(i>}; a,P)=^2 



data 



a[l + 0(0.5 + (co89 s )i)]Nr{{e})} (1 - «) 2 /3 2 



+ 



+ 



ci- 



ot 



a 



2 • 


(49) 



where a a = 0.25 is the normalization error of the atmospheric neutrino flux and <jp = 0.04 is 
the slope error in the zenith angle dependence of the flux [13]. A^ data is the observed number 
of events and N^ xp ({e}) is the expected number of events in the presence of NSI. 

As expected (see discussion in Sec. [Il]), the high energy data sample has very good sensi- 
tivity to e^ T but is practically insensitive to ef '. The low energy sample of data has comparable 
sensitivities to e' and e^ T . These features can be seen from the allowed regions of the pa- 
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FIG. 11: Allowed region in the (e^ T , e') plane for the low and high energy data sample of IceCube-79. 
The cross in each figure shows best-fit value. 



rameters shown in Fig. 11 For the low energy and high energy samples, the value of A% 2 
between best-fit and {e} = is 0.5 and 2.4, respectively. 

Combining the low (DeepCore) and high energy (IceCube-79) analyses, it is possible to 



constrain both NSI parameters e» T and e' to a greater degree. Fig. 12 shows the allowed 



region obtained from the combined analysis of the low and high energy sample (red solid 
curve). In this figure we have shown also the allowed region from IceCube-40, which is 
obtained from the analysis of atmospheric neutrinos in the energy range of 100 GeV to 



400 TeV [T7]. For the IceCube-40 analysis we used the same \ 2 function as in Eq. (49). The 



black dashed curve in Fig. 12 corresponds to the allowed region from Super-Kamiokande 
experiment [5J. As can be seen the limit from IceCube-79 is stronger than the one from 
IceCube-40 due to higher statistics and inclusion of the lower energy data. We have checked 
that combining the IceCube-79 and IceCube-40 do not improve the limit significantly. 

After marginalizing with respect to e' (e^ r ) we obtain the following allowed ranges for e^ T 
and e' at 90% confidence level: 



-6.1 x 10" J <e AtT <5.6 x 10" 



90% C.L. 



(50) 
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FIG. 12: Allowed region in the plane of (e^ T , e') at 90% C.L. obtained from the combined analysis 
of low and high energy samples of data (IceCube-79 and DeepCore respectively), shown by red solid 
curve. The black dashed curve shows the allowed region from Super-Kamiokande experiment, taken 
from |6j, and the green dotted curve is for IceCube-40. The red "x", green "+" and black "*" signs 
show the best-fit values of NSI parameters from IceCube-79, IceCube-40 and Super-Kamiokande 
experiments, respectively. 



3.6 x 10~ 2 < e < 3.1 x 10~ 2 , 



90% C.L. 



(51) 



The high statistics data of IceCube-79 [E v > 100 GeV) can be used to constrain the 



normalization uncertainty of atmospheric neutrino flux (represented by a in Eq. (49)) and 



so increase the sensitivity of DeepCore data to NSI. We performed such an analysis which 



leads to stronger bounds on NSI strength parameters than in Eqs. (50) and (51). However, 



since the systematic errors of IceCube detector is not available yet and the normalization 
uncertainty would be energy dependent, we report in this paper the more conservative limits 



in Eqs. (50) and (51) 



According to Fig. [12j in spite of higher energies of events, the IceCube- 79 bound is 
comparable with the Super-Kamiokande bound. The reason is that the IceCube- 79 limit 
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has been obtained by analyzing the zenith angle distribution of ^—events (that is integrated 
over energy) only; while in the Super-Kamiokande analysis both the zenith angle and energy 
distributions of ^—events have been taken into account. Thus, we expect that stronger limit 



from IceCube data than the one in Fig. 12 can be obtained by performing the energy analysis 



of z/ M — events. 



The limits in Eqs. (50) and (51) are the strongest available limits on the NSI parameters 



e MT and e'. Specifically, the limit on e^ T in Eq. (50) is stronger than the Super-Kamiokande 
limit by a factor of two. 

We have performed an analysis of the data assuming 15% uncorrelated systematic errors 
in each zenith angle bin. This weakens the bounds on e^ T and e' by factor 1.6. 

C. Future sensitivity of DeepCore to e MT and e' 

Future operation of IceCube and especially DeepCore will improve the sensitivity to the 
NSI parameters e MT and e' '. This improvement will be achieved due to higher statistics, lower 
energy threshold of event selection and a possibility to explore the energy dependence of the 
zenith angle distribution below 100 GeV. 

In this section we calculate the sensitivity of DeepCore to the NSI parameters taking 
E u = 10 GeV as the energy threshold. We assume a factor of two uncertainty for the 
neutrino energy resolution (accuracy of reconstruction), that could be reflected by selection 
of the corresponding energy bins: we take three bins: [10 — 20] GeV, [20 — 40] GeV 
and [40 — 80] GeV. IceCube has high precision in the reconstruction of incoming v^ 
[pp) direction (~ 1°). However, in the low energy range the reconstruction of incoming 
neutrino direction is limited by the uncertainty due to the scattering angle of neutrinos 
off nuclei as well as worser reconstruction of the muon direction. It can be approximated 
by A6 Z = l.ly/m p /(E„/GeV), so that A6 Z varies from 19° at E v = 10 GeV to 7° at 
E v = 80 GeV. For simplicity we assume the worst resolution (that is 19°) for the entire 
energy range (10 — 80) GeV. Correspondingly, we consider four bins of cos 6 Z : [—1, —0.9], 
[—0.9, —0.6], [—0.6, —0.3] and [—0.3,0]. The number of events in the z-th bin of cos# 2 and 
j-th bin of E v is given by: 
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FIG. 13: Sensitivity of DeepCore in the plane of (e^ T , e') at 90% C.L. after one year of data-taking 
(shown by red solid curve). The black dotted and blue dashed curves show the allowed region 
from Super-Kamiokande and IceCube-79+DeepCore experiments, respectively. The blue "x" and 
black "*" signs show the best-fit values of NSI parameters from IceCube-79 and Super-Kamiokande 
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FIG. 14: Ax i from Eq. (53), as a function of e^ T and e', for DeepCore experiment after one year 
of data-taking. 
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Nij({e})=TAn [ dcos9 z f dE u (52) 

JAiCos0 z J AjE„ 

[^(E u ,cos9 z )P(^ -> ^)({e}) + $„.(£„, cos 0*)P(i/ e -> ^)({e})] A%(E V , cob 6 g ) 

where for the effective area of DeepCore we use the simulation of [15] and we assume that 
the effective area is independent of the zenith angle: A e g (E u , 6 Z ) = A e s(E v ). Also we assume 
the same effective area for muon neutrino and antineutrino: A u e ^ = A^g- To calculate the 
sensitivity of DeepCore to the NSI parameters, we define the following x 2 function: 
v» ,r A „ m_\- { Ar M(W = 0)-"[l + /3(0-5 + (cos^)]iV M ({ e })} 2 (1 - af /3 2 

XDc(|e| ' '^ " f- ^^» ~^~ rf 

(53) 



where a and /3 have the same meaning as in Eq. (49) (with a a = 0.25 and <y$ = 0.04) 



With this x 2 function, after marginalizing with respect to a and j3, we obtain the sensitivity 



to e MT and d shown in Fig. 13, As can be seen, after one year of data-taking (which is 
already passed) the DeepCore experiment can exclude a large part of the allowed regions 
from Super-Kamiokande and IceCube-79 experiments. 

The marginalized value of A% 2 with respect to d (e MT ), as a function of e^ T (d) is shown 



in Figs. 14 The sensitivity of DeepCore experiment is then 

- 1.7 x 10~ 3 < e Mr < 2.6 x 10" 3 9.5 x 10~ 3 < d < 6. x 10~ 3 90% C.L. (54) 

- 2.7 x 10~ 3 < €^ T < 3.9 x 10~ 3 - 1.2 x 10~ 2 < d < 8.6 x 10~ 3 3a C.L.. (55) 



Comparing these result with those in Eqs. (50) and (51) we find that sensitivity can be 



improved by factor 2 — 3 with one year data of DeepCore. 

IV. DISCRIMINATING NSI FROM STERILE NEUTRINO EFFECTS 

Apart from NSI, new oscillation effects at high energies can be induced by mixing of 
v^ with sterile neutrinos, v s , composed mainly of the mass state with m = 0(1) eV. The 
sterile neutrinos are motivated by various anomalies observed in neutrino experiments [IBT 
[21] (see [22] for a recent global analysis). The oscillations of the active to sterile neutrinos 
lead to distortion of zenith angle distribution of the v^— events [HI [23] which can be quite 
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similar to distortion due to NSI. Effects of v s have, however, certain features which allow to 
disentangle them from NSI effects. In particular, the energy dependence of the distortions 
is different in the two cases. 

To illustrate this we consider the 3 + 1 scenario with Am^ = 1 eV 2 and the mixing 
between the sterile and active neutrinos sin 2 20 w = 4|[/ At 4| 2 (l — |£^4| 2 ) = 0.1. The existence 
of a sterile neutrino with these parameters leads to the MSW active-sterile conversion of the 
nearly up-going v^ with energy ~ 3 TeV [23] (the resonance happens for v^ if Am^ < and 
for v^ if Am^ > 0). Thus, assuming Am 2 ^ > 0, the resonant conversion v^ — > v s results 
in a reduction of the v^ atmospheric flux at cos 6^ ~ — 1. The oscillograms representing the 
survival probability of v^ and v^ can be found in [16] . 

The DeepCore and IceCube allow to measure the zenith angle distributions of events 
in different energy intervals. In this connection we calculate the zenith distribution of the 
z^— events in DeepCore and IceCube for two cases: 1) NSI; 2) the 3 + 1 model. We assume 
a factor of two uncertainty in the reconstruction of neutrino energy, so the energy bins have 
the width [E V ,2E V ]. For the incoming direction of neutrinos we take Acos# 2 = 0.1, which 
is realistic for E v > 100 GeV. Since we are performing here an illustrative analysis to clarify 
the special signatures of the NSI and 3 + 1 model, we assume the same resolution of direction 
reconstruction for the whole energy range in consideration. 



Fig. 15 presents the distortions of the zenith angle distributions for the two different bins 
of neutrino energy. We show the ratios N({e})/N^J B for the NSI parameters e MT = 5 x 10 -3 
and e' = 0; and N(Aml 1 , sin 2 29^)/N^J D for the 3 + 1 model parameters Am 2 x = 1.0 eV 2 
and sin 2 2$^ = 0.1. Here iVf™ is the number of events in the standard 3z/ framework. 

There are two salient features which distinguish NSI from sterile neutrinos. 

1. For the assumed values of 3 + 1 parameters, the MSW resonance occurs at E v ~ 3 TeV, 



which lies within the high energy bin of Fig. 15a Oscillations to sterile neutrinos lead 
to strong suppression of signal as compared with NSI effect. There is no such a strong 
effect in other energy bins. 

2. Another feature is the peak in zenith distribution in the bin cos6 z G [—1, —0.9] and 



[20,40] GeV, for NSI (see Fig. 15b). The peak can be interpreted in the following 
way: the bin [20, 40] GeV contains the minimum of the survival probability for muon 
(anti)neutrino passing the diameter of Earth. The NSI leads to a shift in the position 
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FIG. 15: The ratios of the numbers of events for NSI and 3 + 1 model for the IceCube (a) and 
DeepCore (b). We take for 3 + 1 model Am^i = 1.0 eV 2 and sin 2 20^ = 0.1, and for NSI: 
5 x 10~ 3 and e' = 0. 



of minimum to lower (higher) energies for muon (anti)neutrinos, which can be seen in 
Fig. 11} In the energy bin [20, 40] GeV, in both neutrino and antineutrino channels the 
probability of oscillations in the presence of NSI is larger. But, this is not the case for 
the other bins. 

V. CONCLUSION 

1. We studied effects of NSI on oscillations of the high energy (E v > 20 GeV) atmo- 
spheric neutrinos. The reason for that is that in general, the NSI effects do not disappear 
with increase of energy up to rather high energies. We focussed mainly on the v^ — v T sector. 



2. Oscillograms for the v^ transitions have been constructed for different NSI scenarios 
(values of the NSI strength parameters). NSI's modify the pattern of the oscillograms 
which depend substantially on the presence of the flavor changing parameters and the sign 
of parameters. NSI's dominate above the resonance energy: E v ^> E^(e). Their effect can 
be enhanced at E v ~ E R (e) due to interference with usual oscillations. For low energies 
NSI produce corrections to the standard oscillations of the order e. At high energies the 
effect disappears as e 2 r with decrease of the NSI strength. 
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3. NSI lead to distortion of the zenith angle distributions of events, which depends on the 
neutrino energy at and below En(e). We computed the zenith distributions for the low 
and high energy samples and confronted them with results from IceCube-79 and DeepCore. 
The data from IceCube-79 and DeepCore are in agreement with standard oscillations. This 
allowed us to put new and the most stringent limits on the strength parameters: 

-6.1 x KT 3 < e MT < 5.6 x 10~ 3 , 90% C.L. 

- 3.6 x KT 2 < e TT - e w < 3.1 x 10~ 2 , 90% C.L.. 

4. Future measurements at DeepCore and also at its upgrades will further improve the 
bounds. In particular, we showed that measurements of the energy and zenith angle distri- 
butions in DeepCore will allow to strengthen limit by factor 2 — 3. 

The effects of NSI in the PINGU detector have been studied in [8]. For e ~ 0.1 considered 
in [8] the region of strong NSI effect is at 10 GeV and so PINGU indeed could have good 
sensitivity. However for e ~ 0.01 the NSI effect shifts to 20 — 100 GeV, that is beyond the 
region considered in [8]. 

5. We have shown how effects of NSI can be disentangled from effects of sterile neutrinos 
with mass in the eV range. The two effects have different energy dependencies. There are 
two salient signatures: the MSW resonance dip in TeV range for sterile neutrinos, and sharp 
peak in the zenith angle distribution for NSI in the energy range of the first oscillation 
minimum due to the 2-3 mass splitting. 
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